Method and an electronic device for 3D gesture interaction across nearby electronic devices

ABSTRACT

A method for 3D gesture interaction across electronic devices includes: measuring spatial location information of the electronic devices based on Location Technology; generating a 3D gesture field of the electronic devices based on the spatial location information; setting the location update method, the detection method of 3D gesture, the frequency band of detecting 3D gesture, and the time sequence of detecting gesture at different devices; detecting the cooperative gesture; generating interactive auxiliary messages based on the detection of the cooperative gesture; updating the 3D gesture field if the location of any devices have update; identifying the cooperative gesture in the 3D gesture field of the electronic devices; performing the commands corresponding to the cooperative gesture; detecting that the cooperative gesture is beyond the 3D gesture field of the electronic devices; and sending the cooperative gesture to other electronic devices based on the direction of the cooperative gesture.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority of and the benefit of China ApplicationNo. 202210010943.7, filed on Jan. 6, 2022, the entirety of which isincorporated by reference herein.

FIELD OF THE DISCLOSURE

The present invention is related to 3D gesture applications, and inparticular it is related to a method and an electronic device for 3Dgesture interaction across nearby electronic devices.

DESCRIPTION OF THE RELATED ART

The Ultra-wideband (UWB) chip provides spatial awareness, so that theterminal can accurately measure the distance and direction from thesurrounding UWB devices. For example, the distance accuracy of the UWBchip may be +/−10 cm, and the direction accuracy of the UWB chip may be+/−3 degrees. The ultrasound 3D gesture interaction field is athree-dimensional space that exceeds the size of the electronic device,and the ultrasound 3D gesture interaction field has 180 degrees surroundview, millimeter-level detection accuracy, capability of measuring thedistance of multiple targets at the same time. Furthermore, air gestures(for example, swipe, tag, etc.) are allowed in the front, above, belowor on the side of the electronic device in ultrasound 3D gestureinteraction field.

At present, 3D gesture interaction is mostly simulating 2D touchoperation, which is limited to interaction within a single device or asingle application (APP). The Artificial Intelligence of Things (AIOT)depicts a blueprint for device interconnection. At present, thecollaborative operation of multiple devices still uses 2D touchinteraction as a mainstay. It is still rare to realize the collaborativeoperation of multiple devices based on 3D gestures.

BRIEF SUMMARY OF THE DISCLOSURE

In order to resolve the issue described above, the present inventionprovides a method for 3D gesture interaction across a plurality ofelectronic devices. The method is performed by one of the electronicdevices. The method includes measuring spatial location information ofthe electronic devices based on location technology; generating a 3Dgesture field of the electronic devices based on the spatial locationinformation of the electronic devices; setting the location updatemethod, the detection method of 3D gesture, the frequency band ofdetecting 3D gesture, and the time sequence of detecting gesture atdifferent devices; detecting or receiving the cooperative gesture;generating interactive auxiliary messages based on the detection of thecooperative gesture; Updating the 3D gesture field of the electronicdevices if the location of any devices have update; identifying thecooperative gesture in the 3D gesture field of the electronic devices;performing the commands corresponding to the cooperative gesture;detecting that the cooperative gesture is beyond the 3D gesture field ofthe one electronic device; and sending the cooperative gesture to otherelectronic devices based on the direction of the cooperative gesture.

According to the method above, the Location Technology is Ultra-wideband(UWB) technology.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices, includes mapping the otherelectronic devices to the side of the 3D gesture field of the oneelectronic device. The step of identifying the cooperative gesture inthe 3D gesture field includes: identifying a pick-up gesture;identifying a drag gesture; and identifying a drop gesture.

According to the method above, the step of mapping the other electronicdevices to the side of the 3D gesture field of the one electronic deviceincludes: calculating the direction from the one electronic device tothe other electronic devices; and mapping the other electronic devicesto the side of the 3D gesture field of the one electronic device basedon the direction from the one electronic device to the other electronicdevices.

According to the method above, the step of identifying the pick-upgesture, includes selecting an object that a user wants to share by thepick-up gesture via the 3D gesture field applied by Ultrasound. The stepof identifying the drag gesture includes: showing up pop-up userinterfaces of the other electronic devices according to the directionfrom the one electronic device to the other electronic devices; andgetting a target electronic device among the other electronic devicesvia the direction of the drag gesture.

According to the method above, the target electronic device is gottenwhen an angle β approaches zero. The angle β is the angle between avector

and a vector

. The vector

is the direction from the center of the one of the electronic device tothe side of the 3D gesture field of the one electronic device, and theside of the 3D gesture field is mapped by the other electronic devices.The vector

is the direction from the center of the one electronic device to thecurrent location of the drag gesture.

According to the method above, the step of identifying the drop gestureincludes sending the object which is selected by the pick-up gesture inthe 3D gesture field of the one electronic device to the targetelectronic device via the direction of the drag gesture and the locationof the drop gesture.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices includes creating a combinedgesture field for the one electronic device and the electronic devicenearby the one electronic device via the Location Technology.

According to the method above, the step of creating a combined gesturefield for the one electronic device and the electronic device nearby theone electronic device includes combining the 3D gesture field of the oneelectronic device and that of the electronic device nearby the oneelectronic device via the locations of the one electronic device and theelectronic device nearby the one electronic device and the directionfrom the one electronic device to the electronic device nearby the oneelectronic device.

According to the method above, the step of identifying the pick-upgesture includes selecting an object at the one electronic device by thepick-up gesture.

According to the method above, the step of identifying the drag gestureincludes sending the drag gesture to the electronic device nearby theone electronic device if the drag gesture is beyond the side of the 3Dgesture field of the one electronic device; and showing a drag-gestureuser interface at the electronic device nearby the one electronicdevice.

According to the method above, the step of identifying the drop gestureincludes sending the object selected by the pick-up gesture to theelectronic device nearby the one electronic device.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices includes creating a dynamiccombined gesture field for the one electronic device and multiple movingelectronic devices in the electronic devices via the LocationTechnology.

According to the method above, the step of creating the dynamic combinedgesture field for the one electronic device and the multiple movingelectronic devices in the electronic devices via the Location Technologyincludes combining the 3D gesture field of the one electronic device andthose of the moving electronic devices according to the real-timelocations and the directions of the one electronic device and the movingelectronic devices in indoor coordinates.

According to the method above, the step of identifying the pick-upgesture includes getting the direction of the pick-up gesture of one ofthe moving electronic devices; getting the ID of the other movingelectronic device by comparing the direction of the pick-up gesture withthe direction from the one moving electronic device to the other movingelectronic device; and showing an authorization user interface at theother moving electronic device, and waiting for the other movingelectronic device to agree to the connection.

According to the method above, the step of identifying the drag gestureincludes sending the drag gesture to the one electronic device if thedirection from the other moving electronic device to the one electronicdevice interacts with the 3D gesture field of the one electronic device;and showing a drag-gesture user interface at the one electronic deviceif the drag gesture enters the 3D gesture field of the one electronicdevice.

According to the method above, the step of identifying the drop gestureincludes: showing and controlling the user interface of the other onemoving electronic devices at the one electronic device.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices includes: creating a combinedgesture field for the one electronic device, the other electronicdevice, and a moving electronic device in the electronic devices via theLocation Technology.

According to the method above, the step of creating the combined gesturefield for the one electronic device, the other electronic device, andthe moving electronic device in the electronic devices via the LocationTechnology includes combining the 3D gesture field of the movingelectronic device with those of the one and the other electronic deviceaccording to the locations and the directions of the moving electronicdevice and the one and the other electronic device in the coordinates ofthe moving electronic device when the moving electronic device and theone and the other electronic device are face to face.

According to the method above, the step of identifying the pick-upgesture includes getting the direction from the moving electronic deviceto the other electronic device in the coordinates of the movingelectronic device; calculating the direction from a hand in the pick-upgesture to the other electronic device and the direction from the movingelectronic device to the hand in the pick-up gesture in the coordinatesof the moving electronic device; and getting the ID of the otherelectronic device by comparing the direction from the moving electronicdevice to the other electronic device, the direction from the hand inthe pick-up gesture to the other electronic device, and the directionfrom the moving electronic device to the hand in the pick-up gesture.

According to the method above, the ID of the other electronic device isgotten when the result of a vector

plus a vector

intersect with a vector

. The vector

is the direction from the moving electronic device to the hand in thepick-up gesture. The vector

is the direction from the hand in the pick-up gesture to the otherelectronic device. The vector

is the direction from the moving electronic device to the otherelectronic device.

According to the method above, the step of identifying the drag gestureincludes getting the direction of the drag gesture in the coordinates ofthe moving electronic device; getting the direction from the movingelectronic device to the one electronic device in the coordinates of themoving electronic device; sending the drag gesture and the ID of theother electronic device to the one electronic device if the drag gestureenters the 3D gesture field of the one electronic device; and showing adrag-gesture user interface at the one electronic device if thedirection of the drag gesture and the direction from the movingelectronic device to the one electronic device intersect in the 3Dgesture field of the one electronic device.

According to the method above, the step of identifying the drop gestureincludes showing and controlling the user interface of the otherelectronic device at the one electronic device.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices includes mapping applications ofthe one electronic device to the 3D gesture field of a moving electronicdevice.

According to the method above, the step of mapping applications of theone electronic device to the 3D gesture field of a moving electronicdevice includes mapping the shortcut of a first application at the oneelectronic device to the 3D gesture field of the moving electronicdevice when the one electronic device and the moving electronic deviceare face to face; and combining the 3D gesture field of the movingelectronic device with that of the one electronic device according tothe real-time locations and the directions of the one electronic deviceand the moving electronic device.

According to the method above, the step of identifying the pick-upgesture includes showing a second application at the one electronicdevice, and showing the shortcut of the first application at the movingelectronic device; getting the scope of the pick-up gesture by themoving electronic device, and mapping the scope to the one of theelectronic device; and selecting an object from the second applicationat the one electronic device by the scope of the pick-up gesture.

According to the method above, the step of identifying the drag gestureincludes showing a drag-gesture user interface at the one electronicdevice and the moving electronic device.

According to the method above, the step of identifying the drop gestureincludes sending the object by touching the shortcut of the firstapplication via the drop gesture based on the moving electronic device.

According to the method above, the step of generating the 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices includes mapping applicationshortcuts to the side of the one electronic device.

According to the method above, the step of mapping the applicationshortcuts to the side of the one electronic device includes mapping theshortcut of a first application to the side of the 3D gesture field ofthe one electronic device. Different positions at the side of the 3Dgesture field of the one electronic device correspond to differentshortcuts of the first application.

According to the method above, the step of identifying the pick-upgesture includes showing a second application at the one electronicdevice; and selecting an object from the second application by thepick-up gesture applied by Ultrasound.

According to the method above, the step of identifying the drag gestureincludes showing a drag-gesture user interface at the one electronicdevice; and showing the shortcut of the first application on a pop-upuser interface.

According to the method above, the step of identifying the drop gestureincludes sending the object to the first application by touching theshortcut of the first application via the drop gesture.

The present invention also provides an electronic device which is ableto perform 3D gesture interaction across itself and a plurality ofnearby electronic devices. The electronic device includes a positioningprocessor and a gesture-interaction processor. The positioning processoris configured to measure location information of the electronic deviceand receive spatial location information of the nearby electronicdevices based on Location Technology, and configured to set the locationupdate method, the detection method of 3D gesture, the frequency band ofdetecting 3D gesture, and the time sequence of detecting gesture atdifferent devices. The gesture-interaction processor is configured togenerate a 3D gesture field of the electronic device based on thespatial location information of the electronic device, detect or receivethe cooperative gesture, generate interactive auxiliary messages basedon the detection of the cooperative gesture, Updating the 3D gesturefield of the electronic devices if the location of any devices haveupdate, identify the cooperative gesture in the 3D gesture field of theelectronic device, perform the commands corresponding to the cooperativegesture, detect that the cooperative gesture is beyond the 3D gesturefield of the electronic device, and send the cooperative gesture toother electronic devices based on the direction of the cooperativegesture.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure can be more fully understood by reading the subsequentdetailed description with references made to the accompanying figures.It should be understood that the figures are not drawn to scale inaccordance with standard practice in the industry. In fact, it isallowed to arbitrarily enlarge or reduce the size of components forclear illustration. This means that many special details, relationshipsand methods are disclosed to provide a complete understanding of thedisclosure.

FIG. 1 is a flow chart of a method for 3D gesture interaction across aplurality of electronic devices in accordance with some embodiments ofthe present invention.

FIG. 2A is a schematic diagram of 3D gesture fields and spatial locationinformation of a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 2B is a schematic diagram of different gestures in accordance withsome embodiments of the present invention.

FIG. 3 is a schematic diagram of a scenario 1 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 4 is a schematic diagram of a scenario 2 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 5 is a schematic diagram of a scenario 3 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 6 is a schematic diagram of a scenario 4 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 7 is a schematic diagram of a scenario 5 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 8 is a schematic diagram of a scenario 6 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention.

FIG. 9 is a block diagram of an electronic device 900 in accordance withsome embodiments of the present invention.

DETAILED DESCRIPTION OF THE DISCLOSURE

Certain words are used to refer to specific elements in thespecification and the claims. Those with ordinary knowledge in thetechnical field should understand that hardware manufacturers may usedifferent terms to refer to the same component. The specification andthe claims of the present invention do not use differences in names as away to distinguish elements, but use differences in functions ofelements as a criterion for distinguishing. The “comprise” and “include”mentioned in the entire specification and the claims are open-endedterms, so they should be interpreted as “including but not limited to”.“Generally” means that within an acceptable error range, a person withordinary knowledge in the technical field can solve the technicalproblem within a certain error range, and basically achieve thetechnical effect. In addition, the term “coupled” herein includes anydirect and indirect electrical connection means. Therefore, if it isdescribed in the text that a first device is coupled to a second device,it means that the first device can be directly electrically connected tothe second device, or indirectly electrically connected to the seconddevice through other devices or connecting means.

The following description is the best embodiment expected of the presentinvention. These descriptions are used to illustrate the generalprinciples of the present invention and should not be used to limit thepresent invention. The protection scope of the present invention shouldbe determined on the basis of referring to the scope of the claims ofthe present invention.

FIG. 1 is a flow chart of a method for 3D gesture interaction across aplurality of electronic devices in accordance with some embodiments ofthe present invention. As shown in FIG. 1 , the method of the presentinvention includes measuring spatial location information of theelectronic devices based on a Location technology (step S100);generating a 3D gesture field of the electronic devices based on thespatial location information of the electronic devices (step S102);setting the location update method, the detection method of 3D gesture,the frequency band of detecting 3D gesture, and the time sequence ofdetecting gesture at different devices (step S104); detecting orreceiving the cooperative gesture (step S106); updating the 3D gesturefield of the electronic devices if the location of any devices haveupdate (step S108); generating interactive auxiliary messages based onthe detection of the cooperative gesture (step S110); identifying thecooperative gesture in the 3D gesture field (step S112); performing thecommands corresponding to the cooperative gesture (step S114); detectingwhether the cooperative gesture is beyond the 3D gesture field (stepS116); and sending the cooperative gesture to other electronic devicesbased on the direction of the cooperative gesture (step S118) if thecooperative gesture is beyond the 3D gesture field. In some embodiments,if the cooperative gesture is not beyond the 3D gesture field, then themethod of the present invention is back to step S106.

In some embodiment, the location update method in step S104 includesperiodically measuring spatial location information for moving devices;measuring spatial location information after receiving“need-to-update-location” event from the moving devices; and receivingspatial location information from the moving devices.

FIG. 2A is a schematic diagram of 3D gesture fields and spatial locationinformation of a plurality of electronic devices in accordance with someembodiments of the present invention. FIG. 2A shows the spatial locationinformation in step S100, and the 3D gesture fields of the electronicdevices in step S102. As shown in FIG. 2A, there are an electronicdevice 200 (for example, a smart phone), an electronic device 202 (forexample, a smart television), an electronic device 204 (for example, atablet), and an electronic device 206 (for example, a light) in anindoor space. In some embodiments, the electronic devices 200, 202, 204and 206 all support Ultra-wideband (UWB), so that the electronic device200 can measure spatial location information of electronic devices 202,204, and 206 via Location technology, such as UWB. Assuming that theposition of the electronic device 200 is a zero point of indoorcoordinates, the indoor coordinates of the electronic device 202 is (D₁,α₁, β₁) in polar coordinate system, the indoor coordinates of theelectronic device 204 is (D₂, α₂, β₂) in polar coordinate system, andthe indoor coordinates of the electronic device 206 is (x₃, y₃, z₃) inCartesian coordinate system.

In some embodiments, the electronic devices 200, 202 and 204 alsosupport ultrasound gesture, so that a 3D gesture field 210 is generatedin front of the electronic device 200, a 3D gesture field 212 isgenerated in front of the electronic device 202, and a 3D gesture field214 is generated in front of the electronic device 204. The electronicdevice 200 can perform 3D gesture interaction with the electronicdevices 202, 204 and 206. For example, operations of the electronicdevices 202, 204 and 206 can be controlled by the electronic device 200in the 3D gesture field.

FIG. 2B is a schematic diagram of different gestures in accordance withsome embodiments of the present invention. FIG. 2B shows the cooperativegestures in steps S106 and S110. As shown in FIG. 2B, there are anelectronic device 220 and an electronic device 222 in an indoor space.Since both the electronic devices 220 and 222 support ultrasoundgesture, a 3D gesture field 230 is generated in front of the electronicdevice 220, and a 3D gesture field 232 is generated in front of theelectronic device 222. In some embodiments, the electronic device 220can measure the spatial location information of the electronic device222 based on UWB, so that the direction from the electronic device 220to the electronic device 222 can be known. At first, the electronicdevice 220 detects a pick-up gesture 240 from a user in the 3D gesturefield of itself. The pick-up gesture 240 is able to pick up an objectshowing at the electronic device 220. When the electronic device 220detects that the pick-up gesture 240 becomes a drag gesture 250, and thedrag gesture 250 is moved beyond the 3D gesture field 230, theelectronic device 220 sends the drag gesture 250 and the object which isselected to the electronic device 222 via communication protocol, suchas Bluetooth, Wi-Fi, etc.

After that, when the electronic device 222 detects the drag gesture 250in the 3D gesture field 232, the drag gesture 250 and the selectedobject are shown in the electronic device 222. When the electronicdevice 222 detects that the drag gesture 250 becomes a drop gesture 260,the object selected by the pick-up gesture 240 is shown at theelectronic device 222. Therefore, the 3D gesture interaction between theelectronic devices 220 and 222 has been completed.

FIG. 3 is a schematic diagram of a scenario 1 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 1, there are anelectronic device 300 (for example, a smart phone), an electronic device302 (for example, a laptop), an electronic device 304 (for example, asmart television), an electronic device 306 (for example, a tablet), andan electronic device 308 (for example, a smart phone). In someembodiments, the electronic devices 300, 302, 304, 306 and 308 allsupport UWB, but only the electronic device 300 support ultrasoundgestures. Therefore, the electronic device 300 is able to measurespatial location information of the electronic devices 302, 304, 306 and308 based on Location Technology, such as UWB, and further to generate a3D gesture field 310 based on the spatial location information of theelectronic device 300 and its nearby electronic devices 302, 304, 306and 308.

In some embodiment, the electronic device 300 may set the detectionmethod, the frequency band, and the time sequence of a cooperativegesture, such as a pick-up gesture 320, a drag gesture 330, and a dropgesture 340. The electronic device 300 maps the electronic devices 302,304, 306 and 308 to the side of the 3D gesture field 310 of theelectronic device 300. The electronic device 300 calculates thedirection (for example, the vectors

,

,

, and

) from the center of electronic device 300 to the electronic devices302, 304, 306 and 308. That is, the vector

is obtained by mapping the electronic device 302 to the side of the 3Dgesture field 310 of the electronic device 300. The vector

is obtained by mapping the electronic device 304 to the side of the 3Dgesture field 310 of the electronic device 300. The vector

is obtained by mapping the electronic device 306 to the side of the 3Dgesture field 310 of the electronic device 300. The vector

is obtained by mapping the electronic device 308 to the side of the 3Dgesture field 310 of the electronic device 300. The point O in FIG. 3represents the location of the center of electronic device 300.

After that, the electronic device 300 identifies the cooperative gesturein the 3D gesture field 310. For example, the electronic device 300identifies the pick-up gesture 320, the drag gesture 330, and the dropgesture 340 in the 3D gesture field 310. In detail, the electronicdevice 300 selects an object that a user wants to share by the pick-upgesture 320 via Ultrasound in the 3D gesture field 310. Then, theelectronic device 300 generates interactive auxiliary messages based onthe detection of the cooperative gesture. For example, the electronicdevice 300 shows up pop-up user interfaces of the electronic devices(such as the electronic device 302, 304, 306 or 308) according to thedirection from the electronic device 300 to the electronic device 302,304, 306 or 308. The electronic device 300 gets a target electronicdevice, for example, the electronic device 304 in FIG. 3 , among theother electronic devices via the direction of the drag gesture 330, suchas a vector

in FIG. 3 . In some embodiments, the target electronic device (theelectronic device 304 in FIG. 3 ) is gotten when an angle β approacheszero. The angle β is the angle between the vector

and the vector

. In detail, the vector

is the direction from the center O of the electronic device 300 to thecurrent location of the drag gesture in the 3D gesture field 310.

Finally, the electronic device 300 sends the object which is selected bythe pick-up gesture 320 in the 3D gesture field 310 of the electronicdevice 300 to the electronic device 304 via the direction of the draggesture 330 (for example, the vector

) and the location of the drop gesture 340. In some embodiments, whenthe drop gesture 340 or the drag gesture 330 is beyond the 3D gesturefield 310, the electronic device 300 sends the drop gesture 340 or thedrag gesture 330 to the electronic device 304. In the scenario 1, themethod of the present invention maps nearby devices (for example, theelectronic device 302, 304, 306 and 308) to the side of the 3D gesturefield of the electronic device 300 based on the directions of nearbydevices. The user can interact across multi-devices via the 3D gesturefield of the electronic device 300 which connects other devices. Forexample, the user can quickly share the object selected by the pick-upgesture 320 to nearby devices via the direction of the drag gesture 330.

FIG. 4 is a schematic diagram of a scenario 2 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 2, there are anelectronic device 400 and an electronic device 402. In some embodiments,the electronic devices 400 and 402 both support UWB and ultrasoundgestures. That is, the electronic device 400 can generate a 3D gesturefield 410, and the electronic device 402 can generate a 3D gesture field412. The electronic device 402 is nearby the electronic device 400.However, the 3D gesture field 410 of the electronic device 400 is notoverlapped with the 3D gesture field 412 of the electronic device 402.In some embodiments, there are objects 420, 422 and 424 showing at theelectronic device 400. The method of the present invention (or theelectronic device 400) combines the 3D gesture field 410 of theelectronic device 400 and the 3D gesture field 412 of the electronicdevice 402 nearby the electronic device 400 via the location of theelectronic device 400 and the electronic device 402 nearby theelectronic device 400 and the direction from the electronic device 400to the electronic device 402. After that, the electronic device 400selects the object 420 by a pick-up gesture 440. The electronic device400 then detects a drag gesture 450, and sends the drag gesture 450 tothe electronic device 402 if the drag gesture 450 is beyond the side ofthe 3D gesture field 410 of the electronic device 400.

After the electronic device 402 receives the drag gesture 450 from theelectronic device 400, the electronic device 402 shows a drag-gestureuser interface at itself. When the electronic device 402 detects a dropgesture 460, the electronic device 400 sends the object selected by thepick-up gesture 440 to the electronic device 402, so that an object 430,which is the same as the object 420, is shown at the electronic device402. In some embodiments, the object 422 cannot be picked up due to theobject not support Ctrl+C, so that a prohibiting sign is shown on thepick-up gesture, and an object 432 is also shown the prohibiting sign.In some embodiments, the object 424 can be picked up by a circuitgesture 470. The object 424 at the electronic device 400 can then besent to the electronic device 402 via the drag gesture and the dropgesture to form an object 434. In some embodiments, the user can defineaction or action list for a specific ultrasound gesture, for example,the circuit gesture 470 to pick up the object 424 by partially copyingthe contents of the screen via screen copy Tools/SW.

In the scenario 2, the method of the present invention combines gesturefields of the electronic devices 400 and 402 according to theirlocations and directions. The electronic device 400 sends the draggesture 450 to the electronic device 402 of the drag gesture 450 isbeyond the 3D gesture filed of the electronic device 400. The user caninteract across multi-devices placed side by side via combined gesturefield. For example, the user can copy and paste contents from theelectronic device 400 to the electronic device 402.

FIG. 5 is a schematic diagram of a scenario 3 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 3, there are anelectronic device 500 (for example, a smart phone), an electronic device502 (for example, a smart watch), and an electronic device 504 (forexample, a VR display). In some embodiments, the electronic devices 500,502 and 504 all support UWB and ultrasound gesture. Therefore, a 3Dgesture field 510 is generated in front of the electronic device 500.The electronic device 500 can measure the spatial location informationof electronic devices 502 and 504 in indoor coordinates. In someembodiments, the electronic devices 500 and 502 may be operated by thesame user, but the present invention is not limited thereto. The methodof the present invention combines the 3D gesture field 510 of theelectronic device 500 and the 3D gesture field of the moving electronicdevices (for example, the electronic devices 502 and 504) according tothe real-time locations and the directions of the electronic devices500, 502 and 504 in indoor coordinates.

Then, the method of the present invention gets the direction of apick-up gesture 520 of the electronic device 504, gets the ID of theelectronic device 504 by comparing the direction of the pick-up gesture520 (that is, a vector

) with the direction from the one of the electronic device 502 to theelectronic device 504 (that is, a vector

) After that, the electronic device 504 shows an authorization userinterface for waiting for the user that controlling the electronicdevice 504 to agree to the connection. The method of the presentinvention sends a drag gesture 530 to the electronic device 500 if thedirection from the electronic device 504 to the electronic device 500interacts with the 3D gesture field 510 of the electronic device 500.That is, a vector

interacts with the 3D gesture field 510 of the electronic device 500.The electronic device 500 shows a drag-gesture user interface if thedrag gesture 530 enters the 3D gesture field 510 of the electronicdevice 500. Finally, the user can control the electronic device 504 bycontrolling the user interface of the electronic device 500 at theelectronic device 500. In the scenario 3, the method of the presentinvention combines the 3D gesture field 510 of the electronic device 500with devices on motion (for example, the electronic devices 502 and 504)at indoor absolute coordinates. The user can interact acrossmulti-devices via combined gesture. For example, the user can connectanother moving device (the electronic device 504) via the direction ofgesture by the measurement of the watch (the electronic device 502).

FIG. 6 is a schematic diagram of a scenario 4 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 4, there are anelectronic device 600 (for example, a smart glasses), an electronicdevice 602 (for example, a smart phone), and an electronic device 604(for example, a light). In some embodiments, the electronic devices 600and 602 both support UWB and ultrasound gesture, and the electronicdevice 604 only support UWB. Therefore, the electronic device 600generates a 3D gesture field 610, and the electronic device 602generates a 3D gesture field 602. The electronic device 600 can measurespatial location information of the electronic devices 602 and 604.Similarly, the electronic device 602 can also measure spatial locationinformation of the electronic devices 600 and 604. In some embodiments,the method of the present invention combines the 3D gesture field 610 ofthe electronic device 600 with the 3D gesture field 612 of theelectronic device 602 according to the locations and the directions ofthe electronic devices 600, 602 and 604 in the coordinates of theelectronic device 600 when the electronic device 600 is face to facewith the electronic devices 602 and 604.

In some embodiments, the method of present invention (or the electronicdevice 600) first gets the direction from the electronic device 600 tothe electronic device 604, that is a vector

, in the coordinates of the electronic device 600. Then, the electronicdevice 600 calculates the direction from a hand in a pick-up gesture 620to the electronic device 604, that is a vector

, and the direction from the electronic device 600 to the hand in thepick-up gesture 620, that is a vector

, in the coordinates of the electronic device 600. After that, theelectronic device 600 gets the ID of the electronic device 604 bycomparing the vector

,

, and

. In some embodiments, the ID of the electronic device 604 is gottenwhen the result of the vector

plus the vector

intersect with the vector

.

After that, the method of present invention (or the electronic device600) gets the direction of a drag gesture 630 in the coordinates of theelectronic device 600, that is a vector

Then, the electronic device 600 gets the direction from the electronicdevice 600 to the electronic device 602 in the coordinates of theelectronic device 600, that is a vector

. The electronic device 600 sends the drag gesture 630 and the ID of theelectronic device 604 to the electronic device 602 if the drag gesture630 enters the 3D gesture field 612 of the electronic device 602. Then,the electronic device 602 shows a drag-gesture user interface if thevector

and the vector

intersect in the 3D gesture field 612 of the electronic device 602.Finally, the electronic device 602 shows the drag-gesture userinterface, so that the user can control the electronic device 604 by theuser interface at the electronic device 602. For example, the user canturn on or turn off the electronic device 604 by selecting an object 614via a pick-up gesture 650.

In the scenario 4, the method of present invention combines gesturefield for device on moving with the nearby devices via relativelocations and directions. The user can interact across multi-devicesplaced face to face via dynamic combined gesture field of movingdevices. For example, the user can connect and control IoT devices (theelectronic device 604) via the direction of gesture by the measurementof the glasses or the phone.

FIG. 7 is a schematic diagram of a scenario 5 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 5, there are anelectronic device 700 (for example, smart glasses) and an electronicdevice 702 (for example, a smart phone). In some embodiments, theelectronic devices 700 and 702 both support UWB and ultrasound gesture.Therefore, a 3D gesture field 710 is generated in front of theelectronic device 700. An application APP-A and an application APP-B areboth executed at the electronic device 702. In some embodiments, themethod of present invention first maps applications of the electronicdevices 702 to the 3D gesture field 710 of the electronic device 700. Indetail, the electronic device 700 maps the shortcut of the applicationAPP-B at the electronic device 702 to the 3D gesture field 710 of theelectronic device 700 when the electronic device 702 and the electronicdevice 700 are face to face. The method of present invention combinesthe 3D gesture field 710 of the electronic device 700 with that of theelectronic device 702 according to the real-time locations and thedirections of the electronic devices 700 and 702.

In some embodiments, the application APP-A is shown at the electronicdevice 702, and the shortcut of the application APP-B is shown at theelectronic device 700 (for example, in the 3D gesture field 710). Then,the scope of a pick-up gesture 720 is gotten by the electronic device700, and the scope of the pick-up gesture 720 is mapped to theelectronic device 702. The method of the present invention selects anobject 712 from the application APP-A at the electronic device 702 bythe scope of the pick-up gesture 720 (or a circle gesture). After that,when the electronic device 700 detects a drag gesture 730, adrag-gesture user interface is shown at both the electronic devices 700and 702. Finally, the method of the present invention sends the object712 by touching the shortcut 714 of the application APP-B via a dropgesture 740 based on the electronic device 700.

In the scenario 5, the method of present invention map the shortcut ofuser equipment's application to the 3D gesture field (for example, the3D gesture field 710) of the face-to-face devices for extending functionof 3D gesture. The user can interact across multi-APPs via gesture fieldand display of face-to-face devices. For example, the user can quicklymake notes by the electronic devices 702 and 700.

FIG. 8 is a schematic diagram of a scenario 6 for 3D gesture interactionacross a plurality of electronic devices in accordance with someembodiments of the present invention. In the scenario 6, there is anelectronic device 800. The electronic device 800 supports UWB andultrasound gesture. Therefore, a 3D gesture field 810 is generated infront of the electronic device 800. An application APP-A and anapplication APP-B are both executed at the electronic device 800. Insome embodiments, the method of the present invention maps applicationshortcuts to the side of the electronic device 800 (for example, in theside of the 3D gesture field 810). In detail, the method of the presentinvention maps the shortcut of the application APP-B to the side of the3D gesture field 810 of the electronic device 800. In some embodiments,different positions at the side of the 3D gesture field 810 of theelectronic device 800 correspond to different shortcuts of theapplication.

Then, the application APP-A is shown at the electronic device 800. Themethod of the present invention selects an object 812 from theapplication APP-A by a pick-up gesture 820 applied by Ultrasound. Whenthe electronic device 800 detects a drag gesture 830, the electronicdevice 800 shows a drag-gesture user interface. Then, the method of thepresent invention shows the shortcut of the application APP-B on apop-up user interface 816. Finally, the electronic device 800 sends theobject 812 to the application APP-B by touching the shortcut 814 of theapplication APP-B via a drop gesture 840.

FIG. 9 is a block diagram of an electronic device 900 in accordance withsome embodiments of the present invention. As shown in FIG. 9 , theelectronic device 900 includes a positioning processor 902 and agesture-field processor 904. In some embodiments, the positioningprocessor 902 performs positioning based on UWB. For gesture-fieldprocessor 904, which can be served as the gesture-field processor 904.The electronic device 900 may be any one of the electronic devices 200,202 204, 220 and 222 in FIGS. 2A and 2B, the electronic devices 300,302, 304, 306 and 308 in FIG. 3 , the electronic devices 400 and 402 inFIG. 4 , the electronic devices 500, 502 and 504 in FIG. 5 , theelectronic devices 600 and 602 in FIG. 6 , the electronic devices 700and 702 in FIG. 7 , the electronic device 800 in FIG. 8 . In someembodiments, the positioning processor 902 is configured to obtainlocation information of an electronic device and receive spatiallocation information of the nearby electronic devices based on aLocation Technology, and configured to set the location update method,the detection method of 3D gesture, the frequency band of detecting 3Dgesture, and the time sequence of detecting gesture at differentdevices. That is, the positioning processor 902 of the electronic device900 is able to perform steps S100 and S104 in FIG. 1 . Furthermore, thepositioning processor 902 may send the spatial location information 910to the gesture-field processor 904 for 3D gesture application.

The gesture-field processor 904 is configured to generate a 3D gesturefield of the electronic device based on the spatial location informationof the electronic device, detect or receiving the cooperative gesture,generate interactive auxiliary messages based on the detection of thecooperative gesture, update the 3D gesture field of the electronicdevices if the location of any devices have update, identify thecooperative gesture in the 3D gesture field, perform the commandscorresponding to the cooperative gesture, detect that the cooperativegesture is beyond the 3D gesture field, and send the cooperative gestureto other electronic devices based on the direction of the cooperativegesture. That is, the gesture-field processor 904 is able to performsteps S102, S106, S108, S110, S112, S114, S116 and S118 in FIG. 1 .

At present, the power consumption of ultrasound 3D gestures processor isabout 20 mA. For mobile devices with limited power such as mobilephones/watches, it is difficult to always turn on the ultrasound 3Dgestures processor and wait for user interaction at any time. Therefore,there are three examples that only need to actively turn on the firstelectronic device for gesture interaction. First, the system mayautomatically turns on 3D gesture interaction based on user habits andscene recognition, which is applicable to scenarios 5 and 6. Second,when the user wears a watch/band or other device, the system determineswhether to open the 3D gesture interaction of accessory device based onthe distance/posture, which is applicable to scenarios 1˜6. Third, theuser turns on the 3D gesture interaction of the device manually, whichis applicable to scenarios 1˜6.

There are three examples for plug-in devices to keep 3D gesturerecognition always on. First, plug-in devices such as TV/speakers keep3D gestures always on. Second, the always-on device selects thefollow-up device based on the gesture direction, and informs thefollow-up device to turn on 3D gesture recognition and waits for theuser's subsequent gesture interaction. Third, when the always-on devicefinds that the user is trying to perform 3D gesture interaction with themobile device, the always-on device notifies the mobile device to openthe 3D gesture interaction.

In the several embodiments provided by the present invention, it shouldbe understood that the disclosed system, device, and method can beimplemented using other methods. The device embodiments described aboveare merely illustrative, for example, the division of units is only alogical function division, and there may be other divisions in actualimplementation. For example, multiple units or elements can be combinedor integrated into another system, or some features may be omitted ornot implemented. In addition, the displayed or discussed mutual couplingor direct coupling or communicative connecting may be indirect couplingor communicatively connecting through some interfaces, device or units,and may be in electrical, mechanical, or other forms.

In addition, the functional units in the various embodiments of thepresent invention may be integrated into one processing unit, or eachunit may exist alone physically, or two or more units may be integratedinto one unit. The above-mentioned integrated unit can be realizedeither in the form of hardware or in the form of a software functionalunit.

Although the present invention is disclosed above in the preferredembodiment, it is not intended to limit the scope of the presentinvention. Anyone with ordinary knowledge in the relevant technicalfield can make changes and modifications without departing from thespirit and scope of the present invention. Therefore, the protectionscope of the present invention shall be determined by the scope of theclaims.

What is claimed is:
 1. A method for 3D gesture interaction across aplurality of electronic devices, performed by one of the electronicdevices, comprising: measuring spatial location information of theelectronic devices based on Location Technology; generating a 3D gesturefield of the electronic devices based on the spatial locationinformation of the electronic devices; setting the location updatemethod, the detection method of 3D gesture, the frequency band ofdetecting 3D gesture, and the time sequence of detecting gesture atdifferent devices, wherein the location update method includesperiodically measuring spatial location information for moving devices;detecting or receiving the cooperative gesture; generating interactiveauxiliary messages based on the detection of the cooperative gesture;identifying the cooperative gesture in the 3D gesture field of theelectronic devices; performing the commands corresponding to thecooperative gesture; detecting that the cooperative gesture is beyondthe 3D gesture field; and sending the cooperative gesture to otherelectronic devices based on the direction of the cooperative gesture. 2.The method as claimed in claim 1, wherein the Location Technology isUltra-wideband (UWB).
 3. The method as claimed in claim 1, wherein thestep of generating the 3D gesture field of the electronic devices basedon the spatial location information of the electronic devices comprises:mapping the other electronic devices to the side of the 3D gesture fieldof the one of the electronic devices; wherein the step of identifyingthe cooperative gesture in the 3D gesture field comprises: identifying apick-up gesture; identifying a drag gesture; and/or identifying a dropgesture.
 4. The method as claimed in claim 3, wherein the step ofmapping the other electronic devices to the side of the 3D gesture fieldof the one of the electronic devices comprises: calculating thedirection from the one of the electronic devices to the other electronicdevices; and mapping the other electronic devices to the side of the 3Dgesture field of the one of the electronic devices based on thedirection from the one of the electronic devices to the other electronicdevices.
 5. The method as claimed in claim 4, wherein the step ofidentifying the pick-up gesture comprises: selecting an object that auser wants to share by the pick-up gesture applied by Ultrasound.
 6. Themethod as claimed in claim 5, wherein the step of identifying the draggesture comprises: showing up pop-up user interfaces of the otherelectronic devices according to the direction from the one of theelectronic devices to the other electronic devices; and getting a targetelectronic device among the other electronic devices via the directionof the drag gesture.
 7. The method as claimed in claim 6, wherein thetarget electronic device is gotten when an angle β approaches zero;wherein the angle β is the angle between a vector

and a vector

; wherein the vector

is the direction from the center of the one of the electronic devices tothe side of the 3D gesture field of the one of the electronic devices,and the side of the 3D gesture field is mapped by the other electronicdevices; and wherein the vector

is the direction from the center of the one of the electronic devices tothe current location of the drag gesture.
 8. The method as claimed inclaim 7, wherein the step of identifying the drop gesture comprises:sending the object which is selected by the pick-up gesture in the 3Dgesture field of the one of the electronic devices to the targetelectronic device via the direction of the drag gesture and the locationof the drop gesture.
 9. The method as claimed in claim 1, wherein thestep of generating the 3D gesture field of the electronic devices basedon the spatial location information of the electronic devices comprises:creating a combined gesture field for the one of the electronic devicesand the electronic device nearby the one of the electronic devices viathe Location Technology; wherein the step of identifying the cooperativegesture in the 3D gesture field comprises: identifying a pick-upgesture; identifying a drag gesture; and/or identifying a drop gesture.10. The method as claimed in claim 9, wherein the step of creating acombined gesture field for the one of the electronic devices and theelectronic device nearby the one of the electronic devices comprises:combining the 3D gesture field of the one of the electronic devices andthat of the electronic device nearby the one of the electronic devicesvia the locations of the one of the electronic devices and theelectronic device nearby the one of the electronic devices and thedirection from the one of the electronic devices to the electronicdevice nearby the one of the electronic devices.
 11. The method asclaimed in claim 10, wherein the step of identifying the pick-up gesturecomprises: selecting an object at the one of the electronic devices bythe pick-up gesture.
 12. The method as claimed in claim 11, wherein thestep of identifying the drag gesture comprises: sending the drag gestureto the electronic device nearby the one of the electronic devices if thedrag gesture is beyond the side of the 3D gesture field of the one ofthe electronic devices; and showing a drag-gesture user interface at theelectronic device nearby the one of the electronic devices.
 13. Themethod as claimed in claim 12, wherein the step of identifying the dropgesture comprises: sending the object selected by the pick-up gesture tothe electronic device nearby the one of the electronic devices.
 14. Themethod as claimed in claim 1, wherein the step of generating the 3Dgesture field of the electronic devices based on the spatial locationinformation of the electronic devices comprises: creating a dynamiccombined gesture field for the one of the electronic devices andmultiple moving electronic devices in the electronic devices via theLocation Technology; wherein the step of identifying the cooperativegesture in the 3D gesture field comprises: identifying a pick-upgesture; identifying a drag gesture; and/or identifying a drop gesture.15. The method as claimed in claim 14, wherein the step of creating thedynamic combined gesture field for the one of the electronic devices andthe multiple moving electronic devices in the electronic devices via theLocation Technology, comprises: combining the 3D gesture field of theone of the electronic devices and those of the moving electronic devicesaccording to the real-time locations and the directions of the one ofthe electronic devices and the moving electronic devices in indoorcoordinates.
 16. The method as claimed in claim 15, wherein the step ofidentifying the pick-up gesture comprises: getting the direction of thepick-up gesture of one of the moving electronic devices; getting the IDof the other one of the moving electronic devices by comparing thedirection of the pick-up gesture with the direction from the one of themoving electronic devices to the other one of the moving electronicdevices; and showing an authorization user interface at the other one ofthe moving electronic devices, and waiting for the other one of themoving electronic devices to agree to the connection.
 17. The method asclaimed in claim 16, wherein the step of identifying the drag gesturecomprises: sending the drag gesture to the one of the electronic devicesif the direction from the other one of the moving electronic devices tothe one of the electronic devices interacts with the 3D gesture field ofthe one of the electronic devices; and showing a drag-gesture userinterface at the one of the electronic devices if the drag gestureenters the 3D gesture field of the one of the electronic devices. 18.The method as claimed in claim 17, wherein the step of identifying thedrop gesture comprises: showing and controlling the user interface ofthe other one moving electronic devices at the one of the electronicdevices.
 19. The method as claimed in claim 1, wherein the step ofgenerating the 3D gesture field of the electronic devices based on thespatial location information of the electronic devices comprises:creating a combined gesture field for the one of the electronic devices,the other one of the electronic devices, and a moving electronic devicein the electronic devices via the Location Technology; wherein the stepof identifying the cooperative gesture in the 3D gesture fieldcomprises: identifying a pick-up gesture; identifying a drag gesture;and/or identifying a drop gesture.
 20. The method as claimed in claim19, wherein the step of creating the combined gesture field for the oneof the electronic devices, the other one of the electronic devices, andthe moving electronic device in the electronic devices via the LocationTechnology, comprises: combining the 3D gesture field of the movingelectronic device with those of the one and the other one of theelectronic devices according to the locations and the directions of themoving electronic device and the one and the other one of the electronicdevices in coordinates of the moving electronic device when the movingelectronic device and the one and the other one of the electronicdevices are face to face.
 21. The method as claimed in claim 20, whereinthe step of identifying the pick-up gesture comprises: getting thedirection from the moving electronic device to the other one of theelectronic devices in the coordinates of the moving electronic device;calculating the direction from a hand in the pick-up gesture to theother one of the electronic devices and the direction from the movingelectronic device to the hand in the pick-up gesture in the coordinatesof the moving electronic device; and getting the ID of the other one ofthe electronic devices by comparing the direction from the movingelectronic device to the other one of the electronic devices, thedirection from the hand in the pick-up gesture to the other one of theelectronic devices, and the direction from the moving electronic deviceto the hand in the pick-up gesture.
 22. The method as claimed in claim21, wherein the ID of the other one of the electronic devices is gottenwhen the result of a vector

plus a vector

intersect with the vector

; wherein the vector

is the direction from the moving electronic device to the hand in thepick-up gesture; the vector

is the direction from the hand in the pick-up gesture to the other oneof the electronic devices; and the vector

is the direction from the moving electronic device to the other one ofthe electronic devices.
 23. The method as claimed in claim 22, whereinthe step of identifying the drag gesture comprises: getting thedirection of the drag gesture in the coordinates of the movingelectronic device; getting the direction from the moving electronicdevice to the one of the electronic devices in the coordinates of themoving electronic device; sending the drag gesture and the ID of theother one of the electronic devices to the one of the electronic devicesif the drag gesture enters the 3D gesture field of the one of theelectronic devices; and showing a drag-gesture user interface at the oneof the electronic devices if the direction of the drag gesture and thedirection from the moving electronic device to the one of the electronicdevices intersect in the 3D gesture field of the one of the electronicdevices.
 24. The method as claimed in claim 23, wherein the step ofidentifying the drop gesture comprises: showing and controlling the userinterface of the other one of the electronic devices at the one of theelectronic devices.
 25. The method as claimed in claim 1, wherein thestep of generating the 3D gesture field of the electronic devices basedon the spatial location information of the electronic devices comprises:mapping applications of the one of the electronic devices to the 3Dgesture field of a moving electronic device; wherein the step ofidentifying the cooperative gesture in the 3D gesture field comprises:identifying a pick-up gesture; identifying a drag gesture; and/oridentifying a drop gesture.
 26. The method as claimed in claim 25,wherein the step of mapping applications of the one of the electronicdevices to the 3D gesture field of a moving electronic device comprises:mapping the shortcut of a first application at the one of the electronicdevices to the 3D gesture field of the moving electronic device when theone of the electronic devices and the moving electronic device are faceto face; and combining the 3D gesture field of the moving electronicdevice with that of the one of the electronic devices according to thereal-time locations and the directions of the one of the electronicdevices and the moving electronic device.
 27. The method as claimed inclaim 26, wherein the step of identifying the pick-up gesture comprises:showing a second application at the one of the electronic devices, andshowing the shortcut of the first application at the moving electronicdevice; determining the scope of the pick-up gesture by the movingelectronic device, and mapping the scope to the one of the electronicdevice; and selecting an object from the second application at the oneof the electronic devices by the scope of the pick-up gesture.
 28. Themethod as claimed in claim 27, wherein the step of identifying the draggesture comprises: showing a drag-gesture user interface at the one ofthe electronic devices and the moving electronic device.
 29. The methodas claimed in claim 28, wherein the step of identifying the drop gesturecomprises: sending the object by touching the shortcut of the firstapplication via the drop gesture based on the moving electronic device.30. The method as claimed in claim 1, wherein the step of generating the3D gesture field of the electronic devices based on the spatial locationinformation of the electronic devices comprises: mapping applicationshortcuts to the side of the one of the electronic devices; wherein thestep of identifying the cooperative gesture in the 3D gesture fieldcomprises: identifying a pick-up gesture; identifying a drag gesture;and/or identifying a drop gesture.
 31. The method as claimed in claim30, wherein the step of mapping the application shortcuts to the side ofthe one of the electronic devices comprises: mapping the shortcut of afirst application to the side of the 3D gesture field of the one of theelectronic devices; wherein different positions at the side of the 3Dgesture field of the one of the electronic devices correspond todifferent shortcuts of the first application.
 32. The method as claimedin claim 31, wherein the step of identifying the pick-up gesturecomprises: showing a second application at the one of the electronicdevices; and selecting an object from the second application by thepick-up gesture applied by Ultrasound.
 33. The method as claimed inclaim 32, wherein the step of identifying the drag gesture comprises:showing a drag-gesture user interface at the one of the electronicdevices; and showing the shortcut of the first application on a pop-upuser interface.
 34. The method as claimed in claim 33, wherein the stepof identifying the drop gesture comprises: sending the object to thefirst application by touching the shortcut of the first application viathe drop gesture.
 35. An electronic device, able to perform 3D gestureinteraction across itself and a plurality of nearby electronic devices,comprising: a positioning processor, configured to measure locationinformation of the electronic device and measure spatial locationinformation of the nearby electronic devices based on LocationTechnology, and configured to set the location update method, thedetection method of 3D gesture, the frequency band of detecting 3Dgesture, and the time sequence of detecting gesture at differentdevices, wherein the location update method includes periodicallymeasuring spatial location information for moving devices; and agesture-interaction processor, configured to generate a 3D gesture fieldof the electronic device based on the spatial location information ofthe electronic device, detect or receive the cooperative gesture,generate interactive auxiliary messages based on the detection of thecooperative gesture, identify the cooperative gesture in the 3D gesturefield of the electronic device, perform the commands corresponding tothe cooperative gesture, detect that the cooperative gesture is beyondthe 3D gesture field, and send the cooperative gesture to otherelectronic devices based on the direction of the cooperative gesture.